A Cross-media Retrieval System
نویسندگان
چکیده
We propose a cross-media lecture-on-demand system, in which users can selectively view specific segments of lecture videos by submitting text queries. Users can easily formulate queries by using the textbook associated with a target lecture, even if they cannot come up with effective keywords. Our system extracts the audio track from a target lecture video, generates a transcription by large vocabulary continuous speech recognition, and produces a text index. Experimental results showed that by adapting speech recognition to the topic of the lecture, the recognition accuracy increased and the retrieval accuracy was comparable with that obtained by human transcription.
منابع مشابه
Cross Media Entity and Concept Driven Search
In recent years there is a rapid growth of unstructured text and multimedia content, which includes audio, video and image content on the web and within the enterprise. Handling these large volumes of data is cumbersome without effective methods for content analysis and retrieval. This paper presents Sensefy – a cross media information retrieval system, which uses higher-level semantic concepts...
متن کاملStudy of Cross-media Retrieval Technique Based on Ontology
With the recent advances in information retrieval, cross-media retrieval has been attracting lot of attention, but several issues remain problems such as constructing effective correlations, calculating similarity between different kinds of media objects. To gain better cross-media retrieval performance, it is crucial to mine the semantic correlations among the heterogeneous multimedia data. Th...
متن کاملExpanded vector space model based on word space in cross media retrieval of news speech data
News On Demand System using speech technology usually employs automatic speech transcriptions to retrieve the news data. In the retrieval, users specify a few keywords or sentences as a query and the related news data can be retrieved using the speech transcription. However when users can’t give a query clearly, a video shot of news program which users are watching will become a good query to r...
متن کاملEmotion-driven Chinese folk music-image retrieval based on DE-SVM
In this study, we attempt to explore cross-media retrieval between music and image data based on the emotional correlation. Emotion feature analytic could be the bridge of cross-media retrieval, since emotion represents the user's perspective and effectively meets the user's retrieval need. Currently, there is little research about the emotion correlation of different multimedia data (e.g. imag...
متن کاملIraia: a Portal Technology with a Semantic Layer Coordinating Multimedia Retrieval and Cross-owner Content Building
This paper presents a technology for information portals that supports multimedia retrieval while focusing at the same time on different ecologies of information provider and content owner environments. This means it addresses cross-media information provision and cross-owner content building. The technology was developed under the FP5 project IRAIA and was applied to two different areas: econo...
متن کاملUnsupervised Cross-Media Hashing with Structure Preservation
Recent years have seen the exponential growth of heterogeneous multimedia data. The need for effective and accurate data retrieval from heterogeneous data sources has attracted much research interest in cross-media retrieval. Here, given a query of any media type, cross-media retrieval seeks to find relevant results of different media types from heterogeneous data sources. To facilitate large-s...
متن کامل